Papers with real NLP tasks
MIC: A Multi-task Interactive Curation Tool (2022.emnlp-demos)
Copied to clipboard
| Challenge: | MIC is a human-machine collaborative curation tool for multiple NLP tasks. |
| Approach: | They propose to use a multi-task interactive curation tool for multiple NLP tasks to help solve pain points in real NLP. |
| Outcome: | The proposed tool supports multiple projects with multiple users and allows for collaborative annotations. |
The NLP Task Effectiveness of Long-Range Transformers (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing benchmarks on long-range attention models have not been sufficient to develop efficient Transformers and their practical application on complex NLP tasks. |
| Approach: | They propose to benchmark 7 Transformer variants on 5 difficult NLP tasks and 7 datasets to examine their capacity for long-range attention. |
| Outcome: | The proposed models have advantages on content selection and query-guided decoding, but they come with previously unrecognized drawbacks such as insufficient attention to distant tokens and accumulated approximation error. |